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Hearing aid/spectacles combination 



The present invention relates to a hearing aid/spectacles combination according to flie 
precharacterising clause of Claim 1 . The present invention also relates to a spectacle arm, a 
5 processing unit and a reproduction unit intended for a hearing aid/spectacles combination. 
Such a hearing aid/spectacles combination is disclosed in International Patent 
Application WO 99/21400 and can, for example, be used as a hearing aid for a person hard 
ofhearing. 

WO 99/21400 discloses a combination of two earphones and a pair of spectacles ttiat 
10 is provided in the left and right spectacle arm with several microphones positioned some 
distance apart. In use, these microphones register sound signals from the surroxmdings. The 
combination is furfhCTtnore so equipped that a direction-dependent version of the soxmd 
signal is determined for the soimd signals picked up in each microphone in the right and 
the left spectacle arm, respectively. These direction-dependent sound signals are 
15 transmitted to the two earphones, so that for a user who has placed the respective earphones 
in his or her left and right ears a sound patten is produced that concentrates on the soxmd 
in the direction of view and also describes the direction-dependence of the sound signal, 
based on the principles of binaural soimd reproduction. 

However, it is a problem that the combination of the state of the art takes up a fairly 
20 substantial vol\ra\e in order to accommodate the circuits for the ftmctions that are needed 
for signal processing and reproduction, as well as the power supply for these. The 
combination is thus relatively uncomfortable for a user, for example a person who is hard 
ofhearing, to wear. 

One aim of the present invention is to provide a combination that eliminates the 
25 abovementioned disadvantages. Said aim is achieved by a hearing aid/spectacles 

combination of the type mentioned in the preamble, characterised by the characterising 
measures of Claim 1. 

By constructing the combination from components that are linked to one another it is 
possible to achieve a distribution of the modular functionality, that is to say the 
30 functionality as is defined in modules, over the combination, which increases the comfort 
for the user. 
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What is also achieved by the present invention is that the modules can be localised in 

iifferent components without this resulting in restrictions for the user of the hearing 

Aid/spectacles combination. 

What can also be achieved in the present invention by means of the use of scenarios 

''■■r various use situations is that the modular functionality per scenario is distributed over 
^imponents in such a way that the power requirement is principally minimised with 

.Xiird to the power consumption for wireless signal transfer by selecting the shortest, and 
> least expensive, link betwe^L components for the signal transfer. In this way the power 
•n^es for the components can remain relatively restricted in terms of capacity, as a result 
¥hich the size of said components can also be relatively smaller than is known from the 

J Me of the art. 

Further embodiments of the hearing aid/spectacles combination according to the 
present invention are desoibed in the dependent claims. 

The invention will be explained in more detail below witti reference to a few 
dfmwings, in which a few illustrative embodiments are shown. The drawings are intended 
solely for illustrative purposes and do not serve as a restriction of the inventive concept, 
which is defined by the appended claims. 

In the drawings: 

Figure 1 shows a diagram of the functional construction of a monaural signal 
processing chain in a hearing aid according to the present invention; 

Figure 2 shows a diagrammatic diagram of the hearing aid/spectacles combination; 

Figure 3 shows a block diagram of a first and second microphone array; 

Figure 4 shows a block diagram of a processing unit in a first embodiment; 

Figure 5 shows a block diagram of a first and a second reproduction vinit; 

Figure 6 shows a perspective view of the hearing aid/spectacles combination; 

Figure 7 shows a side view of a spectacle arm provided with a microphone array 
according to the present invention; 

Figure 8 shows a block diagram of a processing xmit in a second embodiment 
according to the present invention; 

Figure 9 shows a first and second reproduction unit in a second embodiment 
according to the present invention; 

Figure 1 0 shows a diagrammatic diagram of a further embodiment of the hearing 
aid/spectacies combination according to the present invention; 
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Figure 1 1 shows the general principle of a beam former as used in the hearing 
aid/spectacles combination according to the present invCTtibn; 

Figure 12 shows a polar diagram of a directional characteristic for an output signal 
Sa, formed by end-fire beam forming; 
5 Figure 13 shows a beam former according to Figure 10, with which a second signal 

Sb can be obtained; 

Figure 14 shows a polar diagram of a directional characteristic for a second output 
signal Sb, formed by focusing; 

Figure 15 shows a diagram for further processing of the output signals Sa and Sb; 
10 Figure 16 shows a diagram for further processing of the output signals Sa and Sb for 

use in a conununication unit such as a headset for a telephone; 

Figure 17 shows a polar directional diagram for signal Sc for a combination of beam 
forming and speech suppression; 

Figure 18 shows the sensitivity of a beam former as a function of the direction and 
1 5 location of a sound so\Hce; 

Figure 1 9 shows the sensitivity of a beam former, set for focusing in the direction of 
the mouth of a user; 

and 

Figure 20 shows the sensitivity of a beam former that is set to receive signal firom the 
20 forward direction and with which signals from the direction of the mouth are suppressed. 

Figure 1 shows a diagram of the functional construction of a monaural signal 
processing chain in a hearing aid according to the present invention. 

In the construction in Figure 1 signal processing functions of a hearing aid for 
processing a monaural signal that is fed to one ear of the user are shown in the monaural 
25 signal processing chain. The hearing aid comprises the following modules: a soxmd 

registration module Bl , a beam forming module B2, a reproduction adaptation module B3, 
a reproduction module B4 and a reproduction control module B5. Arrows in Figure 1 
indicate transfer of signals between the various components. 

Following registration of the soimd signals in block Bl the signals are converted into 
30 digital signals, so that the signals in digital form are processed and transmitted between the 
various function modules within the hearing aid. 

The sound registration module Bl servers for registration of a sound signal that arises 
and is functionally linked to a registration component that comprises a microphone array 2; 
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3 (Figure 2) provided with a nximber of microphones (Figure 7). In this context a sound 
signal that arises must be understood to be: sounds that reach the miarophone array 2; 3 
from the surroundings during use, ITie beam forming module B2 serves to form a sound 
beam from the sound signal registered by the registration component with the aid of the 

5 microphone array 2; 3, such that sound from a specific direction can be ampUfied as 
desired compared with sound from other directions. Thus, a direction-dependent soimd 
signal can be generated so that a user is able to distinguish soimd from a specific direction 
from sound from other directions. The reproduction adaptation module B3 serves to adapt 
the reproduction characteristic of the sound beam, such as, for example, the compression 

10 characteristic and the frequency characteristic, by means of signal processing. The 
reproduction module B4 serves to reproduce the adapted sound beam in a user's ear. 
Finally, the reproduction control module B5 serves to control the reproduction, such as, for 
example, the volume. The modular constmction according to the present invention that has 
been outlined above makes it possible to construct tiie components of hearing aid 

1 5 spectacles with a distribution of the ftmctional modules Bl - B5 over components of a 
hearing aid according to the present invention such that is produced, in which as 
advantageous as possible a choice can be made with regard to the positioning of the 
modules Bl - B5 over the components of the hearing aid spectacles. In this context this 
choice relates to lowering the power consxmiption or to adaptation of the ftmctionality to a 

20 scenario for a given use condition, as will be explained in more detail below. 

Figure 2 shows a diagrammatic diagram of an CTobodiment of a hearing 
aid/spectacles combination according to tiie present invention. The hearing aid/spectacles 
combination 1 according to Figure 2 is intended for binaural sound transmission to the 
user. This leads to a diagranomatic constmction in which two signal processing chains for 

25 each monaural signal are incorporated individually. The hearing aid/spectacles combination 
1 comprises a first microphone array 2, a second microphone array 3, a processing unit 4, a 
first reproduction xmit 5 and a second reproduction unit 6. 

First microphone array 2 is accommodated in a first spectacle arm of a pair of 
spectacles, for example the right spectacle arm 2' (Figure 6). Second microphone array 3 is 

30 accommodated in a second spectacle arm, in this case the left spectacle arm 3' (Figure 6). 
The spectacles are finrthermore shown diagrammatically by connection 1' between first and 
second microphone array. 
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First microphone array 2 has a wireless link to processing unit 4 by means of a 
wireless link VI . Second microphone array 3 is linked to processing unit 4 by means of a 
second wireless link V2. 

First reproduction unit 5 is linked to processing unit 4 by means of a third wireless 
5 link V3. Second reproduction unit 6 is linked to processing unit 4 via a fourth wireless link 
V4. 

First microphone array 2 and second microphone array 3 sarve, in use, to capture first 
and second sound signals, respectively, and to transn^iit these via their respective wireless 
links VI , V2 to processing unit 4. 
10 Processing unit 4 is equipped so as, in use, to receive the first and second sound 

signals via the respective wireless links VI and V2 firom the first microphone array 2 and 
the second miax>phone array 3, to process the signals and to transmit them to the first 
reproduction unit 5 and the second reproduction unit 6 via their respective wireless links 
V3, V4. 

1 5 Processing of the signals received in the processing unit 4 will be explained in more 

detail below. 

The first reproduction imit 5 and the second reproduction unit 6 are equipped so as, in 
use, to receive signals fi-om the processing \mit 4 via the third wireless link V3 and, 
respectively, the fourth wireless link 4 and to feed these as audible audio signals to the 
20 right and the left ear, respectively, of the user. 

The hearing aid/spectacles combination 1 according to tiie present invention 
preferably makes use of analogue techniques to pick up the soimd signals firom the sound 
source, of digital techniques to process the signals and of analogue techniques to reproduce 
the signals. 

25 In the view according to Figure 2, the hearing aid/spectacles combination 1 

comprises a first and a second signal processing chain, the modules Bl, B2, B3, B4 and B5 
for each individual line being distributed over the components 2, 3, 4, 5 and 6 of the 
hearing aid spectacles 1 . This embodiment shows a first example of the way in which 
modules Bl - B5 can be distributed over the components of the hearing aid spectacles. This 

30 will be explained in more detail below. 

In the first embodiment, for example, the sound registration module Bl is 
accommodated in the spectacle frame near the microphone arrays 2 and 3, the beam 
forming module B2 together with tiie reproduction adaptation module B3 and the 
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reproduction control module BS is accommodated in the processing unit 4 and the 
reproduction module B4 is accommodated in tihie reproduction imit 5 and 6. 

Anottier embodiment is, for example, hearing aid spectacles in which the sound 
registration module Bl is accommodated, together with the beam forming module B2, in 
5 the microphone arrays 2 and 3, the reproduction adaptation module B3 and the 

reproduction control modvile B5 are accommodated in the processing unit 4 and the 
reproduction module B4 is accommodated in the reproduction unit 5 and 6, 

A further embodiment is hearing aid spectacles in which the sound registration 
module Bl is accommodated, together with the beam forming module B2, in ttie 
10 microphone arra}^ 2 and 3, the reproduction adaptation module B3 is accommodated, 
together with the reproduction module B4, in the reproduction unit S and 6 and the 
reproduction control module B5 is accommodated in flie processing unit 4 or on the 
spectacles frame. 

In Figure 10a general embodiment is shown in which flie distribution of the modules 
1 5 can be chosen in accordance with further desired use conditions for the hearing 

aid/spectacles combination. This will be explained in more detail with reference to Figure 
10. 

Figure 3 shows a block diagram of first and second microphone array 2, 3 in the first 
embodiment of the hearing aid/spectacles combination according to the present invention. 

20 First miorophone array 2 comprises a number of, for example four, microphones Ml , 

M2, M3, M4, analogue/digital converters ADCl, ADC2, ADC3, ADC4, a first multiplexer 
MPXl and a fixst transmitter TMTRl . Microphone Ml is connected to an input of 
analogue/digital converter ADCL Analogue/digital converter ADCl is connected via its 
output to a first input of the first multiplexer MPXl . Mia:ophone M2 is connected to an 

25 input of analogue/digital convertCT ADC2. Analogue/digital converter ADC2 is connected 
via an output to a second input of the first multiplexor MPXl . Microphone M3 is 
connected to an input of analogue/digital converter ADC3. Analogue/digital converter 
ADC3 is connected via its output to a third input of first multiplexer MPXl . Fourth 
microphone M4 is connected to an input of analogue/digital converter ADC4. 

30 Analogue/digital converter ADC4 is connected via its output to a fourth input of the first 
multiplexer MPXl. MPXl is connected via its output to the first transmitter TMTRl. First 
microphone array 2 furthermore comprises a power source El, shown diagrammatically, 
for supplying the power for the circuit of first microphone array 2. 
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The second microphone array 3 is constructed in a similar maimer: in this example 
second microphone array 3 comprises four microphones M5, M6, M7, M8. Each of the 
microphones M5, M6, M7, M8 is connected to an input of, respectively, fifth 
analogue/digital converter ADC5, sixth analogue/digital converter ADC6, seventh 
5 analogue/digital converter ADC7 and eighth analogue/digital converter ADC8. 

Fifth analogue/digital converter ADC5, sixth analogue/digital converter ADC6, 
seventh analogue/digital converter ADC7 and eighth analogue/digital converter ADC8 are 
connected via their respective outputs to, respectively, a first input, a second input, a third 
input and a fourth input of second multiplexer MPX2. 

10 Second multiplexer MPX2 is connected at its output to a second transmitter TMTR2. 

Second microphone array 2 is provided with a power source E2, shown diagranomatically, 
for supplying power to the circuit of second microphone array 3. 

The first transmitter TMTRl and the second transmitter TMTR2 are equipped to 
transmit soxmd signals that have been picked up by the microphones Ml to M4 and, 

15 respectively, M5 to M8 and have then been digitised and multiplexed, as first and, 
respectively, second digitised sound signals, for example at radio firequency, via the 
respective wireless link VI and V2. 

All conceivable transmission techniques are available for the transmission of the first 
and second digital sound signals. However, it is advisable to take account of the required 

20 dynamic of the signal transfer and the possibility of interference by other transmitters. 

Significant sources of interference can be GSM telephones and other hearing aid/spectacle 
combinations. In order as far as possible to restrict GSM radiation-induced interference, the 
analogue/digital converters ADCl to ADC8 are preferably positioned as close as possible 
to the microphones. The analogue/digital converters are, for example, constmcted as so- 

25 called sigma-delta ADCs. For the requisite dynamic the sigma-delta signals in the ADCs 
are, for example, processed as samples, which in binary representation contain fourteen or 
sixteen bits, a sampling fi-equency of 16 kHz (or higher, for example 32 kHz) being used. 

The sampled signals are then multiplexed in the multiplexers MPXl, MPX2 and fed 
as first and second digital multiplexed sound signals to the respective transmitters TMTRl, 

30 TMTR2. 

The transmission technology of the transmitters TMTRl, TMTR2 must be robust in 
connection with the interferences mentioned and comprises a transmitter protocol that is 
recognised by the processing unit 4 via the wireless link VI, V2. 
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The power supply for the first microphone array 2 and the second microphone array 3 
' - neans of their respective powar sources El, E2 must be such that an adequately long 
(Ka-iod of use of the microphone arrays is possible (for example 18 hours for a day or, for 
example, 126 hours for a week with a use of 1 8 hours per day, but another period of use is 
practicable). Therefore, in the present invention use is preferably made of micro- 
sSI>nic building blocks which have a very low power consiraiption in order to make 
h a long period of use of the hearing aid/spectacles combination possible. 

Figure 4 shows a block diagram of a first embodiment of the processing unit 4 of the 
'img aid/spectacles combination. 
Processing vinit 4 is a digital device and comprises a first receiver RCVRl , a first 
- multiplexer DMPXl, a first finite impulse response filter FIRl, a second finite impulse 
n ^ponse filter FIR2, a third finite impulse response filter FIRS and a fourth finite impulse 
response filter FIR4, a first summator SUMl, a first equaliser/compressor EQCMPRl and 
a third transmitter TMTR3 for, respectively, reception, processing and transmission of the 
1 5 first digitised multiplexed sound signal that is transmitted by the first microphone array 2 
via the wireless link VI . 

Processing unit 4 fiuthermore comprises a second receiver RCVR2, a second 
demultiplexer DMPX2, a fifth finite impulse response filter FIRS, a sixth FIR6, a seventh 
FIR7 and an eighth FIRS, a second summator SUM2, a second equaliser/compressor 
20 EQCMPR2 and a fourth transnnitter TMTR4 for, respectively, reception, processing and 
transmission of the second digitised multiplexed sound signal that has been transmitted by 
the second nndcrophone array 3 via its wireless link V2 to tiie processing imit 4. 

First receiver RCVRl , which is equipped to receive tiie signal firom first ndcrophone 
array 2 via the wireless link VI, is connected at its output to an input of first demultiplexer 
25 DMPXl . For resolving the signal firom first receiver RCVRl into the individual 

microphone signals, first demultiplexer DMPXl is equipped to demultiplex the signal that 
has been received at its input firom the first received RCVRl and to transmit it via its 
outputs to finite impulse response filters FIRl to FIR4. For this purpose demultiplexer 
DMPXl is connected at its first output to the input of fibrst finite impulse response filter 
30 FIRl, connected at its second output to the input of second finite impulse response filter 
FIR2, connected at its third output to third finite impulse response filter FIR3 and 
. connected at its fourth output to fourth finite impulse response filter FIR4. 
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It is pointed out that the number of finite impulse response filters for the first and the 
second microphone array 2, 3 preferably corresponds to the number of miax>phones in each 
of the microphone arrays. 

First finite impulse response filter FIRl is connected at its output to a first input of 
5 first summator SUM! . Second finite impulse response filter FIR2 is connected at its output 
to a second input of first summator SUMl. Third finite impulse response filter FIR3 is 
connected at its output to a third input of first summator SUMl. Finally, fourth finite 
impxilse response filter FIR4 is coimected at its output to a fourth input of first sunmiator 
SUML 

10 The combination of finite impulse response filters FIRl to FIR4 and first summator 

SUMl has the fimction of first beam former BFl for super-resolution beam forming firom 
the first sound signals picked up by the first miarophone array. 

First simmiator SUMl is connected at its output to an input of first 
equaliser/compressor EQCMPRl. An output of first equaliser/compressor EQCMPRl is 

1 5 comiected to an input of third transmitter TMTR3. 

Second receiver RCVR2, which is equipped to receive signals from second 
microphone array 3 via the wireless link Vl, is connected at its output to second 
demultiplexer DMPX2. Second demultiplexer DMPX2 is connected at its output side via a 
first output to fifth finite impulse response filter FIRS, via its second output to FIR6, via its 

20 third output to FIR7 and via its fourth output to FIRS. The finite impulse response filters 
FIRS to FIRS are connected at their oulput to a respective input of second summator 
SUM2. 

The combination of finite impulse response filters FIRS to FIRS and second 
summator SUM2 has the fimction of second beam former BF2 for super resolution beam 
2S forming fix)m the second sound signals picked up by the second microphone array. 

Second simmiator SUM2 is connected at its output to an input of second 
equaliser/compressor EQCMPR2. An output of second equaliser/compressor EQCMPR2 is 
connected to an input of fourth transmitter TMTR4. 

Fxulhemiore, processing unit 4 contains a control imit CTRLl that is equipped to 
30 control the third transmitter TMTR3 and the fourth transmitter TMTR4. 

Control imit CTRLl is connected by a first input to a fiirther output of first 
equaliser/compressor EQCMPRl and connected by a second input to a fiarther output of 
second equaliser/compressor EQCMPR2. Control unit CTRLl is connected via a first 
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output to a further input of third transmitter TMTR3. Control unit CTRLl is connected via 
a second output to a further input of fourtti transmitter TMTR4. Control unit CTRLl is 
connected via a third output to first beam former BFl and via a fourth output to second 
beam former BF2. 

5 For the power supply, processing unit 4 is provided with a power source E3 for 

supplying power to the circuit of processing unit 4, 

Third transmitter TMTR3 and fourth transmitter TMTR4 are equipped to transmit 

signals fed in at their input side, preferably at radio frequency, via a respective wireless link 

V3, V4 to, respectively, first reproduction unit 5 and second reproduction unit 6. 
10 The signals from the first microphone array 2 and the second microphone array 3 are 

thus each processed separately by applying so-called super-resolution beam forming. The 

processing of received signals in the processing unit 4 will now be described for a signal 

received via wireless link VI. Signals that are received via second wireless link V2 are 

processed in a comparable manner. 
15 After receiving a digitised multiplexed sound signal from the first microphone array 

2, the first receiver RCVRl feeds the digitised multiplexed sound signal to first 

demultiplexer DMPXl . 

The signals from the first microphone array 2 and the second microphone array 3 are 

thus each processed separately by applying so-called super-resolution beam forming. The 
20 processing of the signal will now be discussed with reference to the signal from the first 

microphone array 2. 

After the signal from the first microphone array 2 has been received in the receiver 
RCVRl via frie first wireless link VI, the signal is demultiplexed in first demultiplexer 
DMPXl into a number of separate signals that corresponds to the nimiber of microphones 

25 in the first microphone array 2. Via its respective outputs the first demidtiplexer DMPXl 
feeds the separate signals to the respective inputs of the first to fourth finite impulse 
response filters FIRl to FIR4. 

After application of the finite impulse response filters, the separate signals are fed to 
the first summator SUMl, the signals being summed and the desired direction-dependent 

30 output signal being produced. This beam forming technique is disclosed in 

abovementioned Patent Application WO 99/21400. The first summator SUMl feeds the 
signal via its output to an input of the first equaliser/compressor EQCMPRl . 
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The first equaliser /compressor EQCMPRl serves to comp^sate for firequency- 
dependent hearing losses on the part of the user (equalisation function) and to adapt the 
amplification of the signal to the sound level that arises (compression fimction). To this 
end the compressor part of the first equaliser/compressor EQCMPRl preferably comprises 
5 a set of optimised response time and decay time constants. It is also possible that the 
compressor uses multi-channel firequency-dependent compression. Control unit CTRLl 
serves to supply a control signal to the first and second equaliser/compressor EQCMPRl, 
EQCMPR2, which control signal indicates the way in which the equalisation fimction and 
compression fimction have to be carried out. The control unit CTRLl also ensures that the 

10 compression Amotions in EQCMPRl and EQCMPR2 proceed synchronously and no 

intentional differences between the compression fimctions in EQCMPRl and EQCMPR2 
arise. It is pointed out that the equalisation fimction in EQCMPRl and EQCMPR2 can be 
different, for example because of differences in hearing characteristic of the left ear and the 
right ear of a user, for which compensation is required. 

15 The first equaliser/compressor EQCMPRl feeds the equalised and compressed signal 

via its output to the third transmitter TMTR3, which then transmits the digital signal via 
third wireless link V3. 

The first control unit CTRLl as shown in processing unit 4 (Figure 3) also serves to 
transmit reproduction control signals via the third and fourth transmitter TMTR3, TMTR4 

20 to the respective first and second reproduction unit 5, 6. 

With the aid of the reproduction control signal at the second input of the third and/or 
fourth receiver fhe fiarOier processing in the respective first and second reproduction unit S, 
6 is influenced, in accordance with the reproduction control signal that was originally 
generated by the first control imit CTRLl in the processing unit. Such a reproduction 

25 control signal can, for example, be the volume of the reproduction imits. 

The third transndtter TMTR3 is equipped to transmit the direction-dependent output 
signal, preferably at radio firequency, via the third wireless link V3 to the first reproduction 
units. 

In a similar manner a signal that is fed firom second microphone array 3 via the 
30 second wireless link V2 to the second receiver RCVR2 of the processing unit 4 is 

processed to give a second direction-dependent ouQ)ut signal that is transmitted via the 
fourth wireless link by the fourth transmitter TMTR4 to the second reproduction unit 6. 
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It is pointed out that in Figure 3 multiplexing of the sound signals picked up by the 
microphones Ml, M2, M3, M4; M5, M6, M7, M8 takes place and in Figure 4 
demultiplexing takes place because of tiie wireless transmission of flie sound signals from 
the soxmd registration module Bl (the microphone array) to the bundle forming module B2 
5 in the first and, respectively, second monaural signal processing chain. In an embodiment 
in which the sovind registration module Bl and the beam forming module B2 are positioned 
next to one another, multiplexing and demultiplexing can be dispensed with, as can the 
transmission of the multiplexed signal via TMTRl and TMTR2 and reception of the 
multiplexed sigaal via RCVRl and RCVR2. 

10 Incidentally, in the case of wireless transmission of the sound signals from the sound 

registration module Bl to the beam forming module B2 it is also not absolutely essential to 
make use of a multiplex technique. As an altemative the various sound signals can also be 
transmitted at different frequencies between the sound registration modiile Bl and the 
beam forming module B2. Lti the transmission protocol used, use can be made of serial or 

1 5 parallel transmission techniques, or of both. 

Figure 5 shows a block diagram of a first and a second reproduction unit. First 
reproduction unit 5 comprises a third receiver RCVR3, a first digital/analogue converter 
DACl, a first controllable output amplifier PI and a first earphone LL 

Second reproduction unit 6 comprises a fourth receiver RCVR4, a second 

20 digital/analogue converter DAC2, a second controllable output amplifier P2 and a second 
earphone L2. 

First reproduction unit 5 also comprises a power source E4 for siq>plying power to 
die circuit of reproduction unit S. Second reproduction unit 6 comprises a power source ES 
for supplying power to the circuit of second reproduction unit 6. 

25 Third receiver RCVR3, which is equipped to receive signals via a third wireless link 

V3 and is connected at its output side, at a first output, to an input of first digital/analogue 
converter DACl. First digital/analogue converter DACl is connected at its output side to a 
first input of controllable output amplifier PI. Controllable output amplifier PI is 
connected at its output side to first earphone LI. Third receiver RCVR3 is connected at a 

30 second output via a control line to a second input of controllable output amplifier PI. First 
earphone LI generates an amplified first direction-dependent output signal for the user. 
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The circuit between the components is made up in a similar way in the second 
reproduction unit 6, second earphone L2 generating an amplified second direction- 
dependent output signal for the user. 

By using identical systems in the left and right spectacle arm, and by using identical 
5 reproduction units, a binaural sound pattern comprising the amplified first and second 
direction-dependent signal is produced for the user of tihie hearing aid/spectacles 
combination, which sound pattem, in the perception of the user, indicates a direction firom 
which the composite sound signal seems to originate. This is made possible because the left 
beam forming is oriented more to the left and the right beam forming more to the right as a 
10 result of tiie acoustic screening effect of the user's head and by the differences that arise in 
the transit time in the two direction-dependent signals, caused by the incident sound field 
on the two microphone arrays. By way of explanation: a sound field ttiat is incident from 
the left is picked up by the left microphone array somewhat earlier than by the right 
microphone array. The differences that arise in level and transit time correspond to natural 
1 5 binaural hearing. 

It is pointed out that in Figure 5 the transmission of the soimd signal by TMTR3 or 
TMTR4 and the receipt of the signal by RCVR3 and RCVR4, respectively, preferably takes 
place by wireless means. Wireless signal transfer can be dispensed with in an embodiment 
in which the processing unit 4 (or a part thereof, i.e. the reproduction adaptation module 
20 B3) and the reproduction unit 5; 6 are positioned next to one another. 

Figure 6 shows a perspective view of the first embodim«at of the hearing 
aid/spectacles combination according to the present invention. 

In Figure 6 the hearing aid/spectacles combination is shown as an example of an 
implementation. The hearing aid spectacles 1 ' consist of a normal firame, a microphone 
25 array 2; 3 (not visible) being incorporated in each of the spectacle arms 2', 3'. The 

processing unit 4 is also indicated, which is easy for the user of the hearing aid spectacles 
to take with him or her. Finally, the two reproduction units 5, 6, which preferably consist of 
reproduction units that can be fitted completely within the auditory canal, are also shown. 
It is pointed out that in the present invention the application is not restricted to such 
30 reproduction units; other types of reproduction xmits, such as are known to those skilled in 
the art, can also be used. 

It is also possible that yet fijrther sound registration modules or input units are 
incorporated in the combination in addition to the microphones in tiie microphone arrays 2, 
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>, it being possible for sound signals registered by or data input from said other sound 
; pjitration modules or input units to be submitted to the imit 4. 

The hearing aid spectacles 1' can be provided with optically neutral lenses so that the 
hearing aid spectacles can also be used by people who do not have poor sight. 

Figure 7 shows a side view of a spectacle arm provided with a microphone array in a 
. .itg aid/spectacles combination according to the present invention. 

A spectacle arm of the hearing aid/spectacles combination 1 as shown in Figure 6 is 
*n here. The microphones Ml , M2, M3 and M4 are positioned a regular or kregular 
, wce apart in the spectacle arm, which is shown as transparent in the figure. The squares 
frown can also contain, in addition to the microphone, flie analogue/digital converters 
/..XJl to ADC4 required for each microphone. The signals that are generated in the 
microphones Ml - M4 are transmitted to the first transmitter TMTRl via connections (not 
Shown) running in the spectacle arm to the free end of the spectacle arm. Finally, the power 
wurce El for the microphone array, which is connected to the microphones and the ADCs 
via connections (likewise not shown), is also indicated in the free end of the spectacle arm. 

Fvirthermore it is pointed out that it is possible for the ADCs to be positioned 
separately from the associated microphone and, for example, to be in the vicinity of the 
first transmitter TMTRL It is also pointed out that the choice of location for the 
components Ml, M2, M3, M4, TMTRl, El can be different to that shown in Figure 7. 

As a result of the modular constmction of tiie hearing aid/spectacles combination, 
which is linked to one another via wireless links, the problem that many hearing aids suffer 
from, namely lack of space to integrate all necessary fimctions in the hearing aid around the 
user's ear, is avoided. In the case of the present invention the modular constmction of the 
combination ensures that fimctions are positioned separated from one another. 

As a result of this modularity and the associated improvement, i.e. adaptation of the 
power supply for the processing unit 4, it is possible to enable the processing unit 4 to 
process signals in a manner that is particularly powerfiil (for a hearing aid). 

Figure 8 shows a block diagram of a processing unit in a second embodiment of the 
hearing aid/spectacles combination according to the present invention. 

In Figure 8 components with the same reference numerals as in the previous Figures 
1 to 7 refer to the same components in those figures. 

First receiver RCVRl is connected at its output to an input of first demultiplexer 
DMPXl. First demultiplexer DMPXl is connected at its first output to the mput of first 
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finite impxdse response filter FIRl, connected at its second output to the input of second 
fimite impulse response filter FIR2, connected at its third output to third finite impulse 
response filter FIR3 and connected at its fourfli output to fourth finite impulse response 
filter FIR4. 

5 It is pointed out that the number of finite impulse response filters for the first and the 

second microphone array 2, 3 preferably corresponds to the number of microphones in each 
of the microphone arrays* 

First finite impulse response filter FIRl is connected at its ouQ)Ut to a first input of 
summator SUMl • Second finite impulse response filter FIR2 is connected at its output to a 
10 second input of sunmiator SUMl . Third finite impulse response filter FIRS is connected at 
its output to a third input of summator SUMl. Finally, fourth finite impulse response filter 
FIR4 is connected at its output to a fourth input of sunmiator SUMl . 

Summator SUMl is connected at its output to an input of third transmitter TMTR3. 
Secondary receiver RCVR2 is connected at its output to second demultiplexer 
15 DMPX2. 

Second demultiplexer DMPX2 is connected at its output side via a first output to fifth 
finite impulse response filter FIRS, via its second output to FIR6, via its third output to 
FIR7 and via its fourth output to FIRS. The finite impulse response filters FIR5 to FIRS are 
connected at their output to a respective input of second summator SUM2« Second 
20 summator SUM2 is connected at its output to an input at fourth transmitter TMTR4. 

The processing unit 4 comprises a control unit CTRL2 that is equipped to control tibie 
fliird transmitter TMTR3 and the fourth transmitter TMTR4. This control unit will be 
explained in more detail below. 

Figure 9 shows a block diagram of a first and a second reproduction unit 5, 6 in a 
25 second embodiment. In Figure 9 components with the same reference numerals as in the 
previous Figures 1 to 8 refer to the same components in those figures. 

First reproduction unit 5 comprises, in addition to receiver RCVR3, controllable 
output amplifier PI and earphone LI, a first equaliser EQl, a first compressor CMPRl and 
a first digital/analogue converter DACl. 
30 Second reproduction unit 6 comprises, in addition to receiver RCVR4, controllable 

second output amplifier P2 and second earphone L2, a second equaliser EQ2, a second 
compressor CMPR2 and a second digital/analogue converter DAC2. 
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Third receiver RCVR3 is connected at its output side at a first output to a first input 
of equaliser EQl. Equaliser EQl is connected at its output side to a first input of first 
compressor CMPRl . First compressor CMPRl is connected at its output to an input of 
digital/analogue converter DACL Digital/analogue converter DACl is connected at its 
5 output side to a first input of controllable output amplifier P 1 . Controllable ou^ut 

amplifier PI is connected at its output side to first earphone LI . Third receive RCVR3 is 
coimected at a second output via a control line to a second input of equaliser EQl, a second 
input of compressor CMPRl and a second input of controllable output amplifier PL 
The circuit between the components is constructed in a similar way in tihe second 
10 reproduction unit. 

The processing of received signals in the reproduction xmits 5 and 6 according to 
Figure 9 will now be described for the first reproduction unit 5, A sound signal is processed 
in a comparable manner in the second reproduction unit 6. 

Following reception of a first direction-dependent output signal from the first 
1 5 microphone array M2 via the processing vmit 4, the third receiver RC VR3 transnoits the 
signal to the first equaliser EQl. The first equaliser EQl serves to compensate for 
frequency-dependent hearing losses on the part of the user and adapts the fi-equency 
characteristic of the received signal accordingly. The equaliser EQl feeds the equalised 
signal via its output to the first input of the compressor CMPRl . The compressor CMPRl 
20 serves to adapt the amplification of the signal to the sound level that arises. For this 

purpose the compressor preferably comprises a set of optimised response time and decay 
time constants. 

In this context it is possible that the compressor employs multi-channel firequency- 
dependent compression. 

25 At its ou^ut the compressor CMPRl feeds the equalised and compressed signal to 

the digital/analogue converter DACl, which then converts the digital signal into an 
analogue signal. The digital/analogue converter DACl feeds the analogue, equalised, 
compressed signal to the controllable output amplifier PI, Controllable output amplifier PI 
then feeds the signal to the first earphone LI . 

30 The first control unit CTRL2 as shown in processing unit 4 (Figure 8) serves to 

transmit reproduction control signals via the third and fourth transmitter TMTR3, TMTR4 
to the respective first and second reproduction unit 5, 6. The third and fourth receiver 
RCVR3, RCVR4 are equipped to feed control signals, which are received via tiie wireless 
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link V3, V4, via a second output to the equaliser EQl, EQ2, the compressor CMPRl, 
CMPR2 and the controllable output ampUfier PI, P2 of the respective reproduction unit. 
With the aid of the control signal supplied via the second output of the third or fourth 
receiver the processing in the equaliser, the compressor and the controllable output 

5 amplifiea: is influenced in accordance with the control signal that was originally generated 
by the first control unit CTRL2 in the processing unit. Such a reproduction control signal 
can, for example, be the compression function of the reproduction unit, an acoustic control 
for the signal or another sound function. What is achieved in this way is that the 
compressor function in both reproduction units 5, 6 is performed synchronously as well as 

10 possible. 

In addition to the signal processing described above which comprises beam forming 
and firequency characteristic adaptation (equalisation and compression) of the signal, the 
processing unit 4 can also be provided with the facility for performing functions Ihat 
provide even more detailed processing of sound signals. The processing unit 4 can be 
1 5 equipped to provide a function for, for example, additional noise suppression, speech 

recognition functions and speech storage functions. These functions can be applied to the 
signals that are supplied to the processing unit 4 with the aid of the microphone arrays or 
optionally other sound registration means or input units. 

The processing unit 4 makes use of these preferred settings for the equaliser and 
20 compressor in order to set specific reproduction characteristics desired by the user, in order 
to transmit sound signals with these settings to the reproduction units. Because of the 
digital processing in the processing unit such an adaptation of the signal reproduction is 
easy to achieve. By means of control signals via its third and fourth output to the first beam 
foraier BFl and second beam former BF2, respectively, the control unit CTRLl , CTRL2 
25 provides the ability to adapt the beam foraung characteristic of the filters FIRl - FIR4 and 
sunamator SUMl and, respectively, FIRS - FIRS and summator SUM2 to a change in 
preferred settings for signal reproduction. 

As far as the finite impulse response filters FIRl - FIRS are concerned, it is pointed 
out that it is also possible to use other types of filters which make use of impulse response 
30 in the beam formers BFl, BF2, such as infinite impulse response filters. Use can also be 
made of other types of filters, such as, for example, adaptive filters. By means of setting 
suitable characteristics for each individual type, these other types of filters can then be vised 
for beam forming. 
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In one embodiment the processing unit 4 has the facility for storing and, in use, 
employing various preferred settings for signal reproduction, which, for example, 
comprises a speech mode, a traffic mode when travelling, and a music mode for, for 
example, use in a concert hall, or more generally for various sound and use conditions that 
5 impose other requirements on signal processing. 

In one embodiment liie processing unit 4 is implemented in the form of a digital 
signal processor (DSP). 

In a further embodiment the processing vmit 4 has supplementary functionality; for 
example the processing unit is integrated with a GSM telephone, an audio player such as a 
10 radio or an MPS player, or another form of personal audio. There can also be integration 
with a personal information management system such as a Palm Pilot. For this purpose a 
"text-to-speech" synthesis function, for example, can be provided as an additional function 
in the processing xmit 4. Apart from integration with mobile telephones, audio equipment 
and Pahn Pilots, interfacing can also be possible, for example with Bluetooth or with an 
1 5 analogue, digital audio link and/or data link. 

The processing unit 4 can also be provided with a link for signals from such a GSM 
telephone or audio player. This supplementary link can be either a wired connection or a 
wireless link. The supplementary link can be unidirectional or bidirectional and suitable for 
digital or analogue signals that can contain both audio and data. 
20 Furthermore, the use of, for example, the speech mode, the traffic mode and the 

music mode as mentioned above, or the more general concept for various sound conditions, 
can be used as function scenarios in order to distribute the functionality that is present in 
the modules of the hearing aid/spectacles combination according to the present invention 
over the physical parts (components) of the combination in such a way that optimum use, 
25 with respect to signal processing, signal registration and also power consumption, is 

achieved. Each component (i.e. the spectacle frame, optionally the control/processing imit, 
the reproduction units and possibly also a supplCTaentary component as mentioned above) 
of the combination has, as a result of its digital construction, the capacity to perform any 
arbitrary part (module) of the signal processing. 
30 Consequently it is possible to store the optimvmi use for a given situation in a 

scenario and to allow this to be set by the user (via selection means such as, for example, 
the processing or control unit 4; but this could also be one of the other digital (logic) 
components). 
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In the form of a control modiile B5 the selection means are able, on the basis of an 
input selection signal, which relates to a use condition/application of the hearing 
aid/spectacles combination, to determine in which compon^t a function module is able to 
perform its function as advantageously as possible. The criteria on the basis of which this 

5 determination takes place will be explained in more detail below. It is, of course, possible 
that the control module B5 detemdnes that for a ^ven use condition a specific function 
module does not have to make any contribution because, for example, specific signal 
processing that is linked to the function module is not required. One example of this can be 
the use of the hearing aid/spectacles combination as an audio player, where the use of the 

10 beam forming module B2 can be dispensed with because the audio signal in the form of a 
music file, for example, already provides a spatial effect such as stereo. In this example the 
signal processing will be able to be restricted to decoding the music file and adaptation and 
control of the reproduction characteristic. 

The facility for the control module to "employ" the other function modules to 

1 5 perform a task is shown diagranmiatically by the respective connections between B 1 , B2, 
B3, B4andB5. 

It will be understood that if a function module is superfluous for performance of the 
signal processing in the signal processing chain in Figure 1, the connection from a 
preceding module to the relevant siqperfluous module can be skipped and in this case the 

20 connection runs directly to the next required module. Altematively, provision can be made 
that the connection to the relevant superfluous module is retained in the signal processing 
chain but that the signal supplied from the preceding module contains a code that instructs 
the relevant superfluous module not to apply any processing but to transmit the signal 
directly to the next required module. 

25 By using a selection method or a control module it is possible to store the optimimi 

use for a given situation in a scenario and to allow this to be set by the user (via selection 
means such as, for example, the control unit 4; but this could also be one of the other 
digital (logic) components). 

It is also conceivable that the selection means are capable, for example by registration 

30 of coizmiand and control signals in the combination, to detOTnine a use condition on the 
basis of said command and control signals and, on the basis thereof, to activate a scenario 
corresponding thereto. For example, the connection of an audio player results in activation 
of the 'audio player' scenario. Another example is the situation where a GSM is connected. 
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1 1 the user initiates a call via the GSM or if an incoming call is detected, the 'GSM headset' 
scenario is activated. 

With regard to the power consumption it is desirable in the case of wireless signal 
hwsfer between components to select as favourable as possible a location for signal 
5 *^mcessing in order to keep the power consumption acceptable witiiin the desired 

tonality of the combination. The user will find relatively firequent replacement of 
-mies a nuisance, which reduces the user-Mendliness of the combination (and ultimately 
inhibit the use of tiie equipment). Moreover, a potential saving in costs for a user can 
tuhieved by optimisation of the power consumption. 

With regard to the construction of the combination, a number of oriteria can be drawn 
: f u implement the use of scenarios for the pxirposes of an advantageous power 
jwisumption: 

- Space requirement: the space in the reproduction unit 5, 6 that is available for 
fitting a battery will be smaller than the space for this in the spectacles firame 1 

1 5 2', 3'. The available space in the spectacles firame is, in turn, smaller than the 

available space in the control unit 4. 

- Power consumption: the power consumption increases in sequ^ce for the 
following fimctions: reproduction by loudspeakers, registration by microphones, 
signal processing, wireless transmission of signals between components. 

20 - Within wireless transmission the power consumption increases as the distance 

between components between which signals are transmitted increases. 
It follows fi-om the distribution of the available space over the components that the 
space for a battery in a reproduction unit is smaller than the space for a battery in the firame. 
Most space for a battery is available in the control unit. 
25 It also follows from this availabihty of space that possible coimections to other 

systems can preferably be implemented in the control unit. 

It follows from the criteria for power consumption in general and for wireless 
transmission in particular that the wireless link between the components in the spectacles 
frame (the microphone arrays) and reproduction unit on the basis of the distance between 
30 them (when the spectacles are actually worn) will consume less power than the link 

between control unit and reproduction unit or between control unit and spectacles firame. 
These latter two links entail essentially the same distance and on the basis of the mutual 
distance will have virtually the same power consumption. 
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In addition, a number of use situations for the combination are conceivable in which 
the criteria for power consunpiption can play a role: 

1 . The combination serves as a hearing aid with direction-dependent sound 
registration, 

5 2. the combination serves as a reproduction unit for audio signals (from, for 

example, a hi-fi set (or a multimedia PC) provided with various sources such as 
TV, radio, CD player, MPS player) 
3. the combination serves as a headset for a conmaunication system such as a 
telephone in a fixed network or a mobile network. 
10 In addition, there are also situations in which the user is not wearing the spectacles 

frame, for example by putting the frame as a registration unit down on, for example, a 
table, and, by being a short distance away, is still able to use the combination. 

These considerations for power consumption and applications lead to a use of the 
digital components elucidated above in a flexible manner in order to allow the combination 
15 to function in the optimum possible maimer in such applications. To this end the 
functionality of the modules is distributed over flie components as is relatively 
advantageous in a use situation. 

- The following distribution of modules over the components can be used for an 
application as a hearing aid with direction-dependent sound registration: 
20 • sound registration in spectacles frame, signal processing (beam forming and 

reproduction adaptation) in frame, 
and 

• wireless transfer from frame to reproduction units. 

The control xmit is disregarded for active signal processing and will optionally 
25 participate passively to transmit a command to the frame and/or the reproduction 

units to control the setting o^ for example, tone colour and/or volimie. It is also 
possible to install a microphone in the reproduction imit, which microphone takes 
ovCT sound registration if the user selects non-direction-dependent sound 
registration via the control module. 



30 



The following distribution of modules over the components is possible for use as a 
reproduction unit for audio signals: 
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• connection of the audio source to the control unit for inputting an audio signal 
into the control unit, 

• sound registration in the control unit, 

• processing of the audio signal in flie control unit, 

• wireless transfer from control unit to reproduction units. 

- For use as a headset for a conununication system such as a telephone a distribution 
is still dependent on the function of the headset, specifically for reproduction of 
the incoming signal from the telephone, or for converting the user's speech into an 
outgoing signal for the telephone connection. These two ftmctions will be 
explained in more detail below. For the reproduction of an incoming telephony 
signal the distribution over the components is as follows: 

• connection of telephone in control unit, 

• sound re^stration in control unit, 

• signal processing in control tinit, 

• wireless signal transfer to frame, 
and 

• wireless transfer from frame to reproduction unit / reproduction units. 
For conversion of the user's speech to an output signal for the telephone the 
following distribution is suitable: 

• connection of telephone in control unit, 

• sound registration of speech in spectacles frame, 

• wireless signal transfer from frame to control unit, 

• signal processing in the control unit (i.e. selection of liie speech signal from the 
user from ttie sound registered by the microphone arrajr, also see the more detailed 
explanation below), 

• signal transfer from the control unit to the telephone. 

- For use of the spectacles as a separate registration unit use thereof can be made to 
transmit the registered signals directly from the microphone arrays to the (digital) 
reproduction xmits and to process the signals in the reproduction units and to feed 
them via each reproduction unit to one of the user's ears. It can also be 
advantageous, depending on the distances between the components, to transmit 
the signals from the naicrophone array by wireless link to the control unit, to 
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process the signals in this unit and then to transmit them to the reproduction units. 
It is also possible to transmit the \mprocessed signals from the control unit to the 
reproduction units and to process the signals in the latter. It is also possible in the 
reproduction unit to install a microphone which takes over sound registration if 
5 the spectacles are put down. 

Setting of a scenario can take place by means of an input selection signal originating 
from a user. 

It would also be possible for the selection means in the hearing aid/spectacles 
combination to determine a selection for a scenario on the basis of an input selection signal 
10 that relates to, for example, the strength of received signals from one or more of the various 
components or to the measured or anticipated power consvimption of one or more 
components. 

Figure 10 shows a diagrammatic diagram of a ftirther embodiment of the hearing 
aid/spectacles combination according to the present invention. 
15 In Figure 10 components with the same reference numerals as in the previous figures 

refer to the same components in those figures. 

In this embodiment the wireless linking technique is employed in such a way fliat a 
wireless link is possible betwe^ each of the digital components, the first microphone array 
2 wireless linked to processing unit 4 by means of a wireless link VI . Second microphone 
20 array 3 is linked to processing unit 4 by means of a second wireless link V2. 

First reproduction xinit 5 is linked to processing imit 4 by means of a third wireless 
link V3. Second reproduction uiut 6 is linked to processing unit 4 via a fourth wireless link 
V4. 

Furthermore, first microphone array 2 is second microphone array 3 by means of a 
25 fiflh wireless link V5 and to first reproduction unit 5 by means of sixth wireless link V6. 

In addition, second microphone array 3 is fijrfhermore linked to second reproduction 
unit 6 by wireless link V7 and first reproduction xmit 5 is fiirthermore linked to second 
reproduction unit 6 by means of wireless link V8. Second microphone array 3 is 
fijrfhermore linked to reproduction unit 5 via a wireless link V9. First microphone array 2 
30 is fiirthermore linked to reproduction unit 6 via a wireless link VIO. In the embodiment in 
which the processing unit 4 is combined with a GSM telephone the hearing aid/spectacles 
combination can be used as a hands-free set. 
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In this embodiment use can be made of the microphones in one spectacle ami or both 
spectacle arms as input for speech for the telephone. It is possible with the aid of the 
abovCTientioned beam forming technique, in addition to forming a first beam that 
comprises a soimd signal from a sound source some distance away, to generate a further 
5 beam that essentially comprises the sound of the user's own voice. This further beam is 
then used as microphone signal for the hands-free (mobile) telephone. 

It is possible to carry out the processing of the signal from the microphone array or 
the microphone arrays in such a way that the user's speech signal is amplified in the 
optimum manner and signals from other directions and distances are suppressed. Because 
10 the acoustic source of the user's speech is very close to the array or the arrays, optimum use 
can be made of focusing techniques, accoxmt being taken of the spherical propagation of 
the speech signal to the microphones. Consequently, certainly at the high frequencies, 
where the wavelengths are short, it is also possible to differentiate between signals from 
various distances and not only fix>m various directions. 
15 It is pointed out that, in a mann^ appended hereto, it is also possible when selecting 

the speech signal from the fix)nt beam (focusing) to suppress yet further signals from other 
directions by complex summing with optimised complex weighting factors (in terms of 
amplitude, phase and frequency dependency) of: 
1 . the focused speech beam, 
20 2. an endfixe beam that faces forwards and thus contains a large amount of signal fix)m 
xmdesired directions, which can be disruptive for the speech signal, 
3. an endfire beam that faces backwards and thus also contains a large amount of signal 
from undesired directions, which can be dismptive for the speech signal. 

The speech signal that is registered in this way (focusing, optionally supplemented by 
25 the abovementioned complex summing with optimised complex weighting factors) can 
advantageously be used as speech input for, for example, telephony or other forms of 
communication. The hearing aid spectacles are thrai used as a hands-free set. Audio signals 
coming from the other side of the communication line can be transmitted to the 
reproduction units of the hearing aid spectacles. If desired, bundling can remain in 
30 operation at the same time, ambient soxmd also being fed to the ear, but not to the 
communication set (telephone). 

However, it is also conceivable that instead of hearing aid spectacles having the said 
functionality for speech selection and speech suppression, the functionality is in a hearing 
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aid or an audio headset without spectacles specifically being incorporated in the 
combination. 

In the case of speech selection and speech suppression it is also possible that the 
further beam of the sound of the user's own voice is advantageously suppressed compared 
5 with sound that the user receives from the hearing aid/spectacles combination as signal that 
has to be reproduced via the reproduction units (i.e. the output signal for listening from the 
hands-free telephone or sound from the surroundings). 

When a hearing aid is used the aim is to obtain sound amplification, which may or 
may not be direction-d^endent, of the sound from the user's surroundings. A frequent 
10 complaint on the part of users is that the signal from their own speech is also amplified and 
is reproduced too loudly. In order as far as possible to eliminate this disadvantage, the 
signal processing in the microphone array of the hearing aid spectacles is adapted in such a 
way that the amplification of the signal from the user's speech is minimised down to a level 
at which the user who is hard of hearing hears his or her own voice at a normal level 
1 5 compared with the amplified sounds from the surroundings that are transmitted by the 
hearing aid. For this purpose a special form of so-called "null steering" is added to the 
signal processing to take account of the short distance away at which the speech signal is 
generated. The same technology as has been explained above for amplification of the user's 
speech can be used for this purpose, after which a complex (in tams of amplitude and 
20 phase) linear combination (siramiing) of the signals picked up by the microphones in the 
array is employed, which ensures that beam forming in the desired direction continues, 
whilst at the same time there is optimtmi suppression of the signal from the user's speech. 

It is pointed out that a complex non-linear combination of the signals picked up by 
the microphones in the array can also be used to provide beam forming. 
25 The processing unit is particularly suitable for these fimctions because of the digital 

processing character. 

The two applications discussed above (speech amplification and speech suppression) 
can, of course, also be used in combination. 

In the various embodiments, such as hearing aid spectacles or a headset, the 
30 abovementioned microphone array(s) can also serve for communication purposes, such as 
telephony or audio input and output in the case of computer applications, without there 
being any question of the user being hard of hearing. 
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Figure 1 1 shows the general principle of a beam former as used in the hearing 
did/spectacles combination according to the preset invention. 

Four microphones MICl, MIC2, MIC3, MIC4 are taken as an example, but other 
iftiaibers are also possible. What is concerned here can be part of a microphone array, for 
5 *"^^nple in one side of the hearing aid spectacles, the nricrophones being mounted in one 
|cle arm. 

Microphone MICl is connected by its output to an input of a filter Al . In a similar 
^ner microphone MIC2, MIC3 and MIC4, respectively, are connected to filter A2, A3 
- A4. 

The filters Al , A2, A3, A4 are each connected by their respective output to a 
nming unit ADDl for summing signals from each of the microphones to give an output 
^lal Sa, that can then be output firom the output of the summing unit (indicated 
^^grammatically by arrow Sa). 

The filters Al, A2, A3, A4 determine which directional characteristic or focusing is 
4 5 jaehieved for signals that are picked up by the microphones MICl , MIC2, MIC3 and MIC4. 
In Figure 1 1 Al shows a filter that has a specific frequency-dependent amplitude 
factor and phase factor. Such a filter can, for example, be constmcted digitally as an FIR 
(finite impulse re^onse) filter. The same applies for the other filters A2, A3, A4. 

Figure 12 shows a polar diagram of a directional characteristic for an output signal 
20 Sa, formed by end-fire beam forming. 

The filters Al , A2, A3, A4 can, for example, be set to end-fire beam forming, as a 
result of which a first direction-dependent output signal Sa is produced with a maximum of 
the signal in the extension of the microphones, as sketched in the polar diagram in Figure 
12. 

25 Figure 1 3 shows a beam former according to Figure 1 1 , with which a second signal 

Sb can be obtained. 

In addition to the coimection of the output microphone Ml to an input of a filter Al, 
which has been disciissed above, the ou^ut of microphone MICl is also connected to an 
input of a further filter CI. 
30 In a similar manner microphone MIC2, MIC3 and MIC4, respectively, are connected 

to a fiarther filter C2, C3 and C4. 

The filters C 1 , C2, C3 , C4 are each connected by their respective output to a 
summing xmit ADD2 for summing signals from each of the microphones to give a second 
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output signal Sb, which can then be output from the output of the summing unit (indicated 

diagrammatically by arrow S\$). 

The filters CI, C2, C3, C4 determine which directional characteristic or focusing is 

achieved for furOaer signals that are picked up by the ndcrophones MICl, MIC2, MIC3 and 
5 MIC4, These further signals can comprise, for example, the hearing aid/spectacles 

combination wearer's own speech. 

Figure 13 indicates how, from the same microphone array, a first output signal Sa can 

be obtained with the aid of a filter set Al to A4 and a second output signal Sb can be 

obtained from a further filter set C 1 to C4. 
10 By choosing different settings for the filter set Al - A4 and for the further filter set 

CI - C4 it is possible to register a sound source (or sound sources) located relatively far 

away in a first signal Sa and to register a source located relatively close by, such as the 

combination wearer's own speech, in a second signal Sb. 

Figure 14 shows a polar diagram of a directional characteristic for a second output 
1 5 signal Sb, formed by focusing. 

In Figure 14 it is illustrated that the signal Sb is focused on the user's speech and 

consequently has a different directional characteristic than the signal Sa. The focusing 

technique applies, inter alia, transit time corrections to the output signals from the 

microphones in the microphone array, such that after summing these signals, which are 
20 offset with respect to one another in respect of time, an optimum amplified output signal is 

produced from a desired source signal that is in the focus, whilst undesired source signals 

from other directions and other distances away are effectively suppressed. This is possible 

because the speech signal, as desired sovirce signal, is such a short distance away from the 

microphone array that the spherical wave field propagation of the desired source signal 
25 gives specific differences in transit time to the various microphones that differ from the 

differences in transit time of signals from imdesired sources that are in other directions and 

different distances away. 

It is pointed out that there are two main lobes in the directional characteristic because 

all microphones MICl, MIC2, MIC3 and MIC4 are in one line. Therefore, no distinction 
30 can be made betwe^ signals from various directions that make the same angle with the 

line of the microphone array. The direction diagram in Figure 14 is a two-dimensional 

section and shows the two directions left and right. 
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In fact there will be a direction ring arovind the array from which the further signal Sb 
can originate: a sound signal can also be picked up from undesired sources (located close 
by) above and below the plane in which the microphones MICl, MIC2, MIC3 and MIC4 
are located. 

5 An improvement can be obtained with other array configurations, such as a 

combination of an array on the left-hand side and an array on the right-hand side of the 
user. 

A fturther improvement can be achieved if the abovementioned combination is 
expanded by a front array that is at the front of the user. 
10 Figure 15 shows a diagram for further processing of the output signals Sa and Sb. 

Figure 15 shows diagrammatically the way in which the output signals Sa and Sb 
from Figure 13 are multiplied by a complex frequency-dependent weighting factor Wl for 
Sa and W2 for Sb, respectively. The complex multiplied signals are then summed to give a 
third output signal Sc, such that suppression of signals originating from the speech 
1 5 direction is achieved. The third output signal Sc is then fed to an earphone. 

By means of the abovementioned individual processing operations on Sa and Sb and 
the respective directional characteristics used for this pxirpose, speech suppression is active 
not only in the given direction (i.e. the direction of the speech signals) but is also restricted 
to a spatial region a short distance away from the user. What is achieved by this means is 
20 that virtually only the speech signal from the user is suppressed in the processing, whilst 
other sound signals from the same direction as the speech, but originating from a relatively 
greater distance away, are not suppressed. 

Figure 16 shows a diagram for ftirther processing of the output signals Sa and Sb for 
use in a communication unit such as a headset for a telephone. 
25 Figure 16 shows, diagrammatically, the way in which the output signals Sa and Sb 

from Figure 1 3 are multiplied by a complex frequency-dependent weighting factor Wl for 
Sa and W2 for Sb, respectively. The complex, multiplied signals are then summed to give a 
third output signal Sc, in such a way that suppression of signals originating from the speech 
direction is achieved. An incoming signal Cin from a communication link of the 
30 communications unit is summed with the third output signal Sc, so that a speech-reduced 
signal Sd, which essentially comprises sound signals from the user's surroundings, sound 
signals from the communication link, but not the speech signal from the user him- or 
herself, is formed as a fourth output signal. This foxnth output signal Sd is then fed to one 
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or more reproduction units. The signal Sb is also fed as outgoing signal Cout to the 

communication link. 

In the embodiment in Figure 16 a selection from a speech signal is achieved. By 

means of the abovraaentioned separate processing operations on Sa and Sb and the 
S respective directional characteristics used for this purpose, selective registration of a speech 

signal in the given direction (i.e. the direction of the speech signals) and restricted to a 

spatial region a relatively short distance away from the user is possible. 

What is achieved by this means is that during processing virtually only the speech 

signal from the user is registered in the second output signal Sb, whilst other sound signals 
10 from the same direction as the speech, but originating from a relatively greater distance 

away, are suppressed. In this way the second output signal Sb is suitable for use as 

outgoing speech signal Cout for the communication link. 

Figure 17 shows a polar direction diagram of signal Sc for a combination of beam 

forming and speech suppression. 
15 In Figure 1 7 beam forming together with speech suppression is rendered visible as 

the direction diagram of signal Sc. 

Figures 18, 19 and 20 illustrate the relative sensitivity of a microphone array for 

various settings for beam forming. The sensitivity is shown in a grey scale. The darker the 

grey, the greater the sensitivity. 
20 Figure 1 8 shows the sensitivity of a beam former as a ftmction of the direction and 

location of a sound source. The beam former is set to receive signal from the forward 

direction. 

Figure 19 shows the sensitivity of a beam former. The beam former is set for 
focusing in the direction of a user's mouth. 

25 Figure 20 shows the sensitivity of a beam former that is set to receive signal from the 

forward direction and where signals from the direction of the mouth are suppressed. 

Finally, the following is pointed out with regard to the wireless communication 
protocol. For transmission of the signals it is necessary only that audio signals and 
reproduction control signals can be transmitted via the wireless communication links. 

30 It is possible to use digital communication protocols, such as Bluetooth, for this 

purpose. However, such protocols, which are mainly intended for data transfer, are in 
general too complex, too extensive and require a relatively high power consumption. 
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The wireless communication protocol for audio according to the present invention is 
intended for transmission of audio signals and reproduction control signals. 

In addition to the signal processing described above, which comprises beam fomiing 
and frequency characteristic adaptation (equalising and compression of the signal, the 
5 module B3 can also be provided with functions that provide even more detailed processing 
of soimd signals. The module B3 can be provided with a function that provides additional 
noise suppression, speech recognition functions and speech storage functions. These 
functions can be applied to the sound signals that have been picked up with the aid of the 
microphone arrays or optionally other sound registration means. 
10 In addition, only a small transmission range of approximately 1 metre for the 

individual transmitters is needed for the signal transfer between the various components of 
the hearing aid/spectacles combination. The power consumption of the hearing 
aid/spectacles combination can remain advantageously restricted by this means as well. 

As far as the wireless links are concerned, it is fiirthermore pointed out that instead of 
1 5 links at radio frequency it is also possible for the links between the components of flie 
hearing aid/spectacles combination to be links for optical signals. 

It is also possible that the wireless links are constructed as wired connections if the 
hearing aid/spectacles combination according to the present invention is used in an 
environment where wireless communication is impossible or not easily possible. 
20 It is also pointed out that a number of ftirther variants of the hearing aid/spectacles 

combination according to the present invention are also possible within the inventive 
concept as viewed in Figure 1 or Figure 10: 

For instance, it is possible that the hearing aid/spectacles combination has only one 
monaiiral signal processing chain of one microphone array in one of the spectacle arms and 
25 one reproduction unit because the application requires only that sound signal picked up are 
fed to only one ear, for example when the user is hard of hearing in one ear only. 

It can also be the case that the hearing aid/spectacles combination has two 
microphone arrays, each in one spectacle arm, and a single reproduction unit, signals from 
the two microphone arrays being combined to give a single signal for the single 
30 reproduction unit In this case, the sound picked up via two spectacle arms is thus fed to 
one ear. With these variants the number of links, i.e, the number of transmitters and the 
number of receivers, will be lower than in the case of the embodiments as shown in the 
appended figures. 
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Finally, it is pointed out that it is possible for beam forming from a sound signal to 
take place in the spectacle ami or in the reproduction unit. In such cases the processing unit 
for a single processing chain is accommodated in the spectacle arm or the reproduction 
unit, respectively. The separate processing unit can then be dispensed with, as far as beam 

5 forming is concerned, and there can then be a direct wireless link between spectacle arm 
and reproduction unit The functionality of module B5 is placed on both spectacle arms via 
control knobs on the two spectacle arms. 

According to the present invention, a personal network (body area network BAN) can 
be provided in which the processing xmit 4 and one or more reproduction units 5, 6 and 

10 further components (or input units) are incorporated, such as, for example, a mobile 

telephone, an electronic organiser, an MPS player or FM radio, a separate microphone and 
sensors for medical or telemetric applications. Additional functionality for the processing 
imit and the reproduction units is obtained by adding these components. With the aid of the 
communication protocol for audio signals, the processing vinit 4 is then able to receive 

15 audio signals from these accessories and, after processing if necessary, to transmit these 
signals to flie reproduction units. Within the network, the processing unit 4 is able to 
transmit data signals to and receive data signals from components in the personal network. 

The hearing aid spectacles, provided with microphone arrays, can then likewise be 
regarded as an input unit or an accessory. 

20 The body area network facility (BAN) relates to a network worn by a person, 

optionally in the vicinity of the person, the components of which are preferably connected 
to one another by wireless links, but optionally also by means of electrical or optical links. 
In the preferred embodiment where the connections are mainly wireless links, the 
components have a transmission range of approximately at most 1 metre and a bandwidth 

25 of approximately 250 Kb/s to 1 Mb/s. Because of the limited transmission range, the power 
requirement of the components is low and will be approximately 2 milliwatt per 
component. 

It is pointed out that in this case as well the central processing unit 4 can be 
integrated with one or more of the abovementioned components of the body area network. 



